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Analysis  of  Bearing  Errors  from  Acoustic  Arrays 


Harry  L.  Hurd 
Harry  L.  Hurd  Assoc.,  Inc. 
April  25,  2002 


Abstract 

This  report  presents  a  limited  analysis  of  bearing  estimates  based  on  acoustic  sensors. 
Significant  biases  are  found  in  the  bearing  estimates  of  all  the  acoustic  sensor  arrays 
involved  in  the  experiment.  The  explanation  of  the  biases  in  terms  of  other  factors, 
such  as  wind,  range  and  SNR  was  beyond  the  scope  of  this  study.  However,  the  biases 
do  explain  much  of  the  track  bias  observed  in  recent  tracker  evaluations. 

1  Introduction 

This  analysis  was  motivated  by  observations  of  substantial  biases  in  tracks  based  on  bearing 
data  from  acoustical  arrays.  The  particular  data  analyzed  here  was  provided  by  the  ARMY 
Center  of  Excellence  in  Acoustics,  TACOM/ARDEC,  AMSTA-AR-FSF-R,  Picatinny  Arse¬ 
nal.  The  geometric  configuration  of  the  four  sensor  arrays  is  presented  in  Figure  1  along 
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Figure  1:  Array  sensor  positions  and  centerline  of  test  track, 
with  the  oval  roadway  that  was  traversed  by  the  test  vehicle. 
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The  tracking  exercise  consisted  of  4  counter-clockwise  loops  and  4  clockwise  loops  made 
by  an  acoustic  target.  This  study  is  limited  to  the  first  counter  clockwise  loop,  denoted  here 
as  CCW#1.  The  position  estimates  provided  with  the  data  were  developed  by  a  sequential 
localizer  which  gathered  data  into  groups  and  performed  a  position  estimate  using  something 
like  a  least  squares  method.  (The  exact  method  is  unknown  to  us.)  The  positions  developed 
by  this  method  are  plotted  in  Figure  2  along  with  a  dashed  line  to  a  point  marked  with  ”x” 

where  the  targ<  Track  2  Data  f0r  run  #  33  ccw  #  i  at  00:21 :26  utc  T72  @  i 5  km/h  Sure  3  presents 
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Figure  2:  Sequential  localizer  position  estimates  (black)  along  with  time 
aligned  truth  track  (red  ”x”)  for  segment  CCW#1. 

the  positional  errors  relative  to  the  mean  X  error  mx  —  —10.52  meters  and  the  mean  Y 
error  my  —  —32.7  meters.  The  standard  deviation  of  the  first  principal  component  (along 
the  line  of  slope  138.8°)  is  26.3  meters  and  along  the  2nd  principal  component  it  is  15.1 
meters.  So  the  bias  my  is  very  large  (negatively,  or  to  the  south)  compared  to  the  variation 
in  the  first  principal  component.  The  histogram  of  miss  distances  is  presented  in  Figure  4 
which  also  shows  the  mean  miss  distance  to  be  43.6  meters. 

A  batch  tracker  is  one  in  which  all  relevant  measurement  data  in  a  time  window  are 
used  to  estimate  the  parameters  of  target  motion.  In  this  case  target  motion  was  assumed 
to  be  along  a  straight  line.  In  statistical  language,  the  data  are  regressed  on  the  function 

P{t)  =  [a/(t0)  +  vx{t  -  t0),y{t0)  +vy(t  -t0),vx,vy\ 

where  x(to),y(to)  are  the  coordinates  at  some  reference  time  to  and  vx.  vy  are  the  velocity 
components.  Further  details  of  the  batch  tracking  algorithm  will  be  documented  separately. 
Figure  5  shows  the  positional  errors  of  the  batch  tracker  relative  to  the  mean  X  error 
mx  —  —3.49  meters  and  the  mean  Y  error  my  —  —16.7  meters.  The  standard  deviation 
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Track  2  Data  for  RUN  #  33  CCW  #  1 
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Figure  3:  Scatter  plot  of  position  errors  of  sequential  localizer  from  segment 
CCW#1. 
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medx:  -19.5637 
medy: -42.1955 
meanx:  -10.5221 
meany:  -32.7016 
sigmaj:  26.384 
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thefa:  138.8089 
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Track  2  Data  for  RUN  #  33  CCW  #  1  histogram  of  miss  distances  av:  43.618 
40 1 - 1 - 1 - 1 - 1 - 1 - 1 - 1 - 


Figure  4:  Histogram  of  miss  distances  of  sequential  localizer  from  segment 
CCW#1.  Mean  miss  distance  is  43.6  meters. 


of  the  first  principal  component  (along  the  line  of  slope  201.5°)  is  18.3  meters  and  along 
the  2nd  principal  component  it  is  12.8  meters.  So  the  mean  errors  of  the  tracker  positions 
are  about  half  of  the  sequential  localizer  and  the  standard  deviations  along  the  principal 
components  are  reduced  as  well.  However,  the  southerly  bias  my  —  —16.7  is  still  substantial. 
The  histogram  of  miss  distances  is  presented  in  Figure  6  which  also  shows  the  mean  miss 
distance  to  be  22.3  meters. 

In  order  to  see  the  effect  of  biases  in  the  bearings,  the  experimental  bearings  were 
replaced  with  simulated  normally  distributed  bearings  (taken  modulo  360deg)  all  having 
zero  mean  and  a  —  3  degrees.  Figure  7  shows  the  positional  errors  of  the  batch  tracker 
relative  to  the  mean  X  error  mx  —  .14  meters  and  the  mean  Y  error  my  —  —.97  meters. 
The  standard  deviation  of  the  first  principal  component  (along  the  line  of  slope  93.2°)  is 
10.8  meters  and  along  the  2nd  principal  component  it  is  5.7  meters.  So  the  mean  errors 
of  the  tracker  positions  based  on  simulated  bearings  are  less  than  1/10  th  of  the  mean 
errors  of  those  produced  by  operational  bearing  estimates.  The  standard  deviations  along 
the  principal  components  are  also  about  half  those  based  on  the  operational  data.  The 
histogram  of  miss  distances  presented  in  Figure  8  shows  the  mean  miss  distance  to  be  9.76 
meters,  less  than  half  that  of  the  operational  data  shown  in  Figure  6.  The  various  miss 
distances  and  principal  component  standard  deviations  are  summarized  for  the  three  cases 
in  Table  1. 
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Figure  5:  Scatter  plot  of  position  errors  of  batch  tracker  from  segment 

CCW#1. 
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Figure  6:  Histogram  of  miss  distances  of  batch  tracker  from  segment 
CCW#1.  Mean  miss  distance  is  22.3  meters. 
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Figure  7:  Scatter  plot  of  position  errors  of  batch  tracker  from  segment 
CCW#1  using  simulated  bearings  with  a  —  3.. 
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Figure  8:  Histogram  of  miss  distances  of  batch  tracker  from  segment 
CCW#1  using  simulated  bearings  with  a  —  3.  Mean  miss  distance  is  9.76 
meters. 
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mY  md  <i\ 


Case 


mx 


02 


Seq.  Loc. 

CCW#l,Run  No. 

33 

-10.52 

-32.7 

43.6 

26.3 

15.1 

Bat.  Tkr. 

CCW#l,Run  No. 

33 

-3.49 

-16.7 

22.3 

18.3 

12.8 

Bat.  Tkr. 

simulated  data 

.14 

-.97 

9.76 

10.8 

5.7 

Table  1:  Summary  of  positional  errors.  md  is  mean  miss  discance.  o\  is 
for  largest  principal  component,  corresponding  to  the  semi-major  axis  of  the 
ellipse  derived  from  the  sample  covariance;  02  is  for  second  largest  principal 
component,  corresponding  to  the  semi-minor  axis. 


math  bearing  history  from  node  1 


Figure  9:  Red:  Node  1  bearings.  Black:  true  bearings. 


2  Analysis  of  bearing  errors 

Bearings  from  each  of  the  four  nodes  are  presented  in  Figures  9  through  12.  The  measured 
bearings  are  in  red  and  the  true  bearings  in  black.  The  blue  dashed  lines  are  at  spacing  of 
45  degrees.  In  all  these  plots,  the  bearings  that  produce  large  errors  are  possibly  due  to 
interfering  signals  that  capture  the  bearing  estimation  process  for  short  times.  We  exclude 
these  in  this  analysis  as  tracking  programs  often  have  methods  of  removing  outliers.  But  in 
a  multiple  target  environment,  the  problem  needs  to  be  given  further  thought.  Note  that 
the  target  bearings  cross  0  degrees  during  the  target  trajectory  for  nodes  2  and  3,  while 
this  does  not  occur  for  nodes  1  and  4.  For  all  nodes,  the  long  stretch  of  constant  bearing 
correspond  to  the  target  remaining  fixed,  or  nearly  fixed  at  the  top  of  the  roadway  between 
the  transits.  Even  at  the  scale  used  for  these  figures  we  can  see  evidence  of  “localized” 
biases. 
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math  bearing  history  from  node  2 


Figure  10:  Red:  Node  2  bearings.  Black:  true  bearings. 


math  bearing  history  from  node  3 


Figure  11:  Red:  Node  3  bearings.  Black:  true  bearings. 
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math  bearing  history  from  node  4 


Figure  12:  Red:  Node  4  bearings.  Black:  true  bearings. 


Figure  9,  Node  1.  The  stretches  where  the  bearing  is  nearly  constant  at  the  top  of  the 
track  produce  biases  that  are  negative  (true  bearing  is  larger  than  that  reported); 
note  this  corresponds  to  a  northerly  bias.  On  the  other  hand,  when  the  target  is  at 
the  bottom  of  the  track,  the  bearing  bias  is  positive  which  would  cause  a  southerly 
bias.  The  bias  switches  from  negative  to  positive  during  the  transit.  Figure  13,  in 
which  the  bearings  around  and  during  transit  CCW#1  are  presented,  shows  the  bias 
sign  change  more  clearly. 

Figure  10,  Node  2.  In  the  northern  part  of  the  track,  when  the  true  bearings  are  around 
85  degrees,  the  bias  is  negative,  producing  southerly  and  easterly  biases  in  tracks. 
For  bearings  corresponding  to  the  southern  part  of  a  transit,  the  biases  are  small  or 
slightly  negative  which  again  produces  southerly  track  bias. 

Figure  11,  Node  3.  In  the  northern  part  of  the  track,  when  the  true  bearings  are  around 
85  degrees,  the  bias  is  positive,  producing  northerly  and  westerly  track  bias.  For 
bearings  corresponding  to  the  southern  part  of  a  transit,  the  bearing  bias  switches 
from  positive  to  negative  (in  all  of  the  transits)  when  the  true  bearing  is  approximately 
280  degrees.  Note  that  the  minimum  bearing  in  this  region  does  not  correspond  to 
the  most  southerly  point  on  the  transit,  which  occurs  later,  roughly  at  the  time  when 
the  bias  switches.  This  would  suggest,  for  this  node,  that  the  estimated  bearing  is 
consistently  lagging  the  target  in  this  region.  This  effect  does  not  seem  to  be  prevalent, 
but  still  it  should  be  studied  further. 
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Figure  12,  Node  4.  Bearing  biases  appear  always  to  be  positive.  In  both  the  northern 
and  southern  parts  of  a  transit  this  will  produce  a  southerly  track  bias. 


Bearing  history,  node  1 ,  cluster  1 ,  CCW  #1 


Figure  13:  Red:  Node  1  bearings  during  CCW#1.  Black:  true  bearings. 


Since  localized  biases  can  be  easily  perceived  in  plots  9  through  12,  histograms  of  bearing 
error  were  produced  in  which  there  was  conditioning  (as  in  conditional  probability)  on 
sectors  of  true  bearing.  The  sectors  were  30  deg  in  width  and  were  chosen  to  cover  the 
range  of  bearings  in  as  few  sectors  as  possible.  The  resulting  histograms  appear  in  Figures 
15  through  18.  The  sample  means  and  standard  deviations  are  presented  in  Table  2.  The 
N/S  (north/south)  effect  on  track  bias  entries  are  determined  by  consideration  of  the  true 
target  positions  relative  to  the  sensors  at  the  time  interval  during  which  the  measurements 
were  made. 


3  Conclusions 

Target  positions  estimated  using  bearing  measurements  from  the  bearing  data  show  definite 
a  southerly  bias.  The  southerly  biases  were  my  —  —32.7  the  sequential  localizer  and 
my  —  —16.7  for  the  batch  tracker.  These  biases  suggested  the  possibility  of  biases  in 
the  bearing  measurements.  Histograms  of  bearing  errors  conditioned  on  30  degree  true 
bearing  sectors  show  the  presence  of  significant  bearing  bias  that  appears  consistent  with 
the  reported  positional  bias.  Although  bearing  sector  provides  a  method  of  analysis  that 
is  informative,  the  causes  of  bearing  bias  need  further  investigation.  Possible  causes  for 
bearing  bias  include  (a)  sound  speed  errors  including  wind  effects,  (b)  array  configuration 
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(a)  Node  1  Cluster  1. 


(b)  Node  2  Cluster  1. 


bearing  errors  cluster  1 ,  node  3  bearing  errors  cluster  1 ,  node  4 


Figure  14:  (Top  in  all  figures)  Histograms  of  bearing  errors  from  indicated  node.  (Bottom 
in  all  figures)  Histograms  of  bearing  errors  in  the  range  [—20, 20]  degrees. 
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nd:1  lims:1 10,140  nd:1  lims:140,170  nd:1  lims:1 70,200 


Figure  15:  Histograms  of  bearing  errors  by  sector.  Node  1  Cluster  1. 


nd:2  lims:0,30  nd:2  lims:30,60  nd:2  lims:60,90 


nd:2  lims:270,300  nd:2  lims:300,330  nd:2  lims:330,360 


Figure  16:  Histograms  of  bearing  errors  by  sector.  Node  2  Cluster  1. 
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nd:3  lims:0,30  nd:3  lims:30,60  nd:3  lims:60,90 


nd:3  lims:270,300  nd:3  lims:300,330  nd:3  lims:330,360 


Figure  17:  Histograms  of  bearing  errors  by  sector.  Node  3  Cluster  1. 


nd:4  lims:1 50,1 80  nd:4  iims:180,210  nd:4  lims:21 0,240 


Figure  18:  Histograms  of  bearing  errors  by  sector.  Node  4  Cluster  1. 
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(0,  30) 

44 

-6.50 

2.80 
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(30,60) 

72 

-3.51 

2.59 

s 

(60,90) 

830 

-2.47 

2.20 

s 

(270,300) 

99 

-3.06 

2.39 

s 

(300,330) 

63 

-5.0 

3.73 

s 

(330,360) 

31 

-6.35 

2.05 

s 

3 

(0,  30) 

35 

-3.56 

2.91 

s 

3 

(30,60) 

54 

1.56 

2.21 

N 

3 

(60,90) 

623 

.81 

2.95 

N 

3 

(270,300) 

400 

.09 

3.08 

N 

3 

(300,330) 

80 

-7.25 

2.84 

s 

3 

(330,360) 

28 

-7.36 

1.55 

s 

4 

(150,180) 

131 

6.0 

1.76 

s 

4 

(180,210) 

108 

4.46 

2.07 

s 

4 

(210,240) 

199 

3.08 

3.17 

s 

4 

(240,270) 

99 

3.88 

3.64 

s 

Table  2:  Summary  of  bearing  analysis  by  sectors. 


errors,  (c)  bearing  estimation  algorithm,  (d)  target  range  and  aspect,  both  of  which  affect 
SNR. 

Efforts  should  be  undertaken  to  better  understand  these  effects. 
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